REPORT  DOCUMENTATION  PAGE 


AFRL-SR-AR-TR-04- 


The  public  reporting  burden  for  this  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the 
gathering  and  maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  i 
of  information,  including  suggestions  for  reducing  the  burden,  to  Department  of  Defense,  Washington  Headquartei 
(0704-0188),  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington,  VA  22202-4302.  Respondents  should  be  awa^‘  t 
subject  to  any  penalty  for  failing  to  comply  with  a  collection  of  information  if  it  does  not  display  a  currently  valid  OMB  cont. 

PLEASE  DO  NOT  RETURN  YOUR  FORM  TO  THE  ABOVE  ADDRESS. 


1.  REPORT  DATE  2.  REPORT  TYPE 

Final  Report 


4.  TITLE  AND  SUBTITLE 

Information  Flow  in  Cooperative  Control  of  Multi- Vehicle  Systems 


(52^0 


6.  AUTHORCS) 

Dr.  Richard  Murray 


3.  DATES  COVERED  (From  -  To) 

Jun  15,  01  -  Dec  31,  03 


5a.  CONTRACT  NUMBER 


5b.  GRANT  NUMBER 

F49620-0M-0460 


5c.  PROGRAM  ELEMENT  NUMBER 


5d.  PROJECT  NUMBER 


5e.  TASK  NUMBER 


5f.  WORK  UNIT  NUMBER 


^  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 
California  Institute  of  Technology 
Pasadena,  CA  91125 


8.  PERFORMING  ORGANIZATION 
REPORT  NUMBER 


9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADpRESS(ES) 

Department  of  the  Air  Force  4015  Wilson  Blvd. 

Air  Force  Office  of  Scientific  Research  Arlington,  VA  22203-1954 


12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Distribution  Statement:  Approved  for  public  release;  distribution  unlimited 


10.  SPONSOR/MONITOR'S  ACRONYM(S) 


11.  SPONSOR/MONITOR'S  REPORT 
NUMBERIS) 


13.  SUPPLEMENTARY  NOTES 

DODAAD  CODE: 

Program  Manager:  Lt.  Col.  Sharon  Heise 


14.  ABSTRACT 


Over  the  three  years  of  this  project,  we  obtained  a  substantial  collection  of  results  that  relate  the  topology  of  the  underlying 
communications  network  to  the  stability  of  the  overall  system,  under  the  assumption  of  identical  linear  dynamics  for  each  vehicle 
(nodes).  These  results  characterize  the  stability  of  the  system  in  terms  of  the  frequency  response  of  the  individual  evhicle  dynamics 
and  the  eigenvalues  of  the  Laplacian  Matrix  associated  with  the  communications  topology.  Extensions  to  the  basic  stability  theorem 
have  been  obtained  that  accoxmt  for  nonlinear  plant  dynamis,  switching  communications  graphs,  and  disturbance  propogation. 


15.  SUBJECT  TERMS 


20040S20  053 


16.  SECURITY  CLASSIFICATION  OF: 

a.  REPORT 

b.  ABSTRACT 

c.  THIS  PAGE 

17.  LIMITATION  OF 
ABSTRACT 


18.  NUMBER  19a.  NAME  OF  RESPONSIBLE  PERSON 
OF  Dr.  Richard  Murray 
pages  - - — 

19b.  TELEPHONE  NUMBER  (Include  area  code) 


Best  Available  Copy 


Standard  Form  298  (Rev.  8/98) 

Prescribed  by  ANSI  Std.  239.18 


INFORMATION  FLOW  IN  COOPERATIVE  CONTROL 
OF  MULTI- VEHICLE  SYSTEMS 

Final  Report 

AFOSR  GRANT  F49620-0 1-1-0460 


Richard  Murray  Alex  Fax^ 

Control  and  Dynamical  Systems 
California  Institute  of  Technology 
Pasadena,  CA  91125 

Abstract 

This  project  focused  on  developing  the  ianderl3dng  theory  required  to  achieve 
integration  of  information  flow  into  control  analysis  and  design  for  cooperative 
tasks  of  multi-vehicle  systems.  By  making  use  of  tools  from  control  theory, 
dynamic^  systems,  and  graph  theory,  we  developed  a  framework  for  analysing 
the  effects  of  information  and  sensor  topology  on  feedback  systems  and  devel¬ 
oping  tools  for  designing  information  flow  aind  control  algorithms  that  build 
on  this  framework.  We  applied  these  ideas  to  several  test  problems  involving 
real-time,  distributed  control  of  a  set  of  multiple  vehicles  performing  cooper¬ 
ative  tasks.  In  addition  to  computational  exploration  through  simulation,  we 
implemented  our  algorithms  on  a  multi-vehicle,  wireless  testbed  for  networked 
control,  commimications,  and  computing  that  was  developed  at  Caltech. 


1  Accomplishments 

Over  the  three  years  of  this  project,  we  obtained  a  substantial  collection  of  results 
that  relate  the  topology  of  the  underlying  commimications  network  to  the  stability 
of  the  overall  system,  under  the  assumption  of  identical  linear  dynamics  for  each 
vehicle  (nodes).  These  results  characterize  the  stability  of  the  system  in  terms  of 
the  frequency  response  of  the  individual  vehicle  dynamics  and  the  eigenvalues  of  the 
Laplacian  matrix  associated  with  the  communications  topology.  Extensions  to  the 
basic  stability  theorem  have  been  obtained  that  account  for  nonlinear  plant  dynamics, 
switching  communication  graphs,  and  disturbance  propogation. 

Graph  Laplacians  and  Formation  Stability 

Our  initial  work  used  tools  from  graph  theory  and  control  theory  to  derive  a  simple 
stability  criteria  for  formation  stabilization  [4].  The  interconnection  between  vehicles 
(i.e.,  which  vehicles  are  sensed  by  other  vehicles)  is  modeled  as  a  graph,  and  the 
eigenvalues  of  the  Laplacian  matrix  of  the  graph  axe  used  in  stating  a  Nyquist-like 
stability  criterion  for  vehicle  formations.  The  location  of  the  Laplacian  eigenvalues 
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can  be  correlated  to  the  graph  structure,  and  therefore  used  to  identify  desirable 
and  undesirable  formation  intercoimection  topologies.  Building  on  this  work,  we 
have  considered  several  problems  that  arise  in  cooperative  control  of  multi-vehicle 
systems. 

Vehicles  in  formation  often  lack  global  information  regarding  the  state  of  all  the 
vehicles,  a  deficiency  which  can  lead  to  instabihty  and  poor  performance.  We  have 
demonstrated  how  exchange  of  minimal  amounts  of  information  between  vehicles  can 
be  designed  to  realize  a  dynamical  system  which  supplies  each  vehicle  with  a  shared 
reference  trajectory  [4].  When  the  information  fiow  law  is  placed  in  the  control 
loop,  a  separation  principle  is  proven  which  guarantees  stability  of  the  formation  and 
convergence  of  the  information  flow  law  regardless  of  the  information  flow  topology. 

Together,  these  results  provide  a  framework  for  analyzing  the  stability  of  inter¬ 
connected  systems  and  understanding  the  relationship  between  the  individual  vehicle 
dynamics  and  the  topology  of  the  communications  network  through  which  the  vehi¬ 
cles  share  information.  Recent  work  has  been  aimed  at  extending  these  results  to 
nonlinear  systems,  analyzing  disturbance  rejection  properties  (so-called  string  stabil¬ 
ity)  using  graph  Laplacians,  and  studying  the  effects  of  switching  communications 
topologies  on  stabihty. 

Uncertain  Communications  Cheinnels 

Our  work  on  graph  Laplacians  considered  only  the  topology  of  the  network  connect¬ 
ing  vehicles.  In  more  realistic  situations,  one  would  like  to  have  a  more  accurate 
model  of  the  communications  channel  and  understand  the  effects  of  the  channel  dy¬ 
namics  on  the  system  performance.  We  explored  this  path  by  studying  techniques  for 
jump  Markov  processes,  in  which  each  Markov  state  corresponds  to  a  given  channel 
configuration.  This  framework  can  be  used  to  model  channels  with  varying  delay, 
bandwidth,  or  SNR  properties  through  a  discrete  collection  of  models. 

Prior  work  in  this  area  had  shown  that  if  the  Markov  state  was  known,  it  was 
possible  to  stabilize  the  jump  Markov  system  under  certain  conditions.  These  condi¬ 
tions  related  to  individual  Markov  state  dynamics  to  the  transition  rates  between  the 
Markov  states.  We  extended  these  results  to  allow  the  Markov  state  to  be  estimated 
(using,  for  example,  the  Viterbi  algorithm)  [7].  These  results  allow  us  to  design  con¬ 
trol  laws  for  the  different  conununication  channel  conditions  and  interconnect  them 
to  achieve  stability  in  the  presence  of  uncertain  channel  conditions.  We  have  applied 
the  results  to  the  specific  case  of  changing  network  communications  topology  [6]  and 
further  extended  the  results  to  compute  optimal  control  laws  under  fixed  communi¬ 
cations  structure  [5]. 

Nonlinear  Networked  Sytems 

Further  extension  of  the  initial  results  in  this  grant  considered  stability  analysis  prob¬ 
lem  for  nonlinear  systems  which  have  general  Unear  feedback  interconnections  [3]. 
We  presented  necessary  conditions  for  stability  of  a  classification  of  interconnected 
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systems,  and  we  gave  some  examples  to  provide  insight  into  this  problem.  These  con¬ 
ditions  are  related  to  positive  definiteness  of  matrices  associated  with  the  feedback 
interconnection,  and  specialize  to  the  common  case  where  the  Laplacian  matrix  of  a 
graph  represents  the  communication  topology  of  the  system. 

Multi- Vehicle  Wireless  Testbed 

The  techniques  developed  under  this  grant  have  being  implemented  on  the  Caltech 
multi- vehicle  testbed.  The  testbed  consists  of  8  mobile  vehicles  with  embedded  com¬ 
puting  and  communications  capability.  A  unique  feature  of  the  testbed  is  the  use  of 
vehicles  that  have  second  order  dynamics,  requiring  real-time  feedback  algorithms  to 
stabilize  the  system  while  performing  cooperative  tasks. 

Students  supported  by  this  project  have  been  involved  in  implementing  control 
laws  for  the  testbed  as  well  as  developing  the  Bluetooth  communications  capability  [1, 
2].  This  infrastructure  was  used  to  demonstrate  theoretical  results  for  control  of 
interconnected  systems  [?]. 
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